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Abstract. A digital frequency multiplexing (DfMUX) system has been developed and used to tune large arrays of transition 
edge sensor (TES) bolometers read out with SQUID arrays for mm-wavelength cosmology telescopes. The DfMUX system 
multiplexes the input bias voltages and output currents for several bolometers on a single set of cryogenic wires. Multiplexing 
reduces the heat load on the camera's sub-Kelvin cryogenic detector stage. In this paper we describe the algorithms and 
software used to set up and optimize the operation of the bolometric camera. The algorithms are implemented on soft 
processors embedded within FPGA devices operating on each backend readout board. The result is a fully parallelized 
implementation for which the setup time is independent of the array size. 
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INTRODUCTION 

A new generation of mm-wavelength experiments use 
(or will use) arrays of hundreds or thousands of tran- 
sition edge sensor (TES) bolometers operating at sub- 
Kelvin temperatures to image the cosmic microwave 
background (CMB) to unprecedented precision in the 
search for new galaxy clusters or the polarization im- 
print left by inflation. One key element in the cryogenic 
design for these experiments is the reduction of read- 
out wiring, which is accomplished for APEX-SZ Q], the 
South Pole Telescope (SPT) 0, EBEX and Polar- 
bear [ 4 ] by multiplexing the bolometer sky-signals in the 
frequency domain. 

In this paper we describe tuning algorithms and soft- 
ware developed for the new digital backend electron- 
ics in use for EBEX and POLARBEAR. This sys- 
tem is the evolution of the analog backend | 6 ] deployed 
on APEX-SZ and the SPT. The new system provides an 
order of magnitude reduction in power consumption and 
size, improvements in low-frequency noise performance, 
and a faster, more robust setup. As most of the system 
complexity is encapsulated in reprogrammable firmware, 
it is easily adapted to the requirements of specific exper- 
iments. 

Figure [T] shows a circuit with Af-bolometers multi- 
plexed on a single set of wires and read out through a 
SQUID operating in shunt feedback (5]|6|. The box on 
the left labelled 'DfMUX' (for digital frequency multi- 
plexer') represents firmware implemented on a Field Pro- 




FIGURE 1. Schematic diagram showing N bolometers mul- 
tiplexed through a single set of wires and SQUID in the Digital 
frequency domain multiplexer system. 



grammable Gate Array (FPGA) that performs the signal 
processing for the system digitally. A digital multifre- 
quency synthesizer (DMFS) produces a sine- wave bias 
carrier for each channel and sums them to form a "comb" 
in frequency space. Each bolometer in the multiplexer 
module is in series with an inductor-capacitor (LC) fil- 
ter that selects a single bias that is uniquely positioned in 
frequency- space. 

Intensity variations from the sky- signal change the 
bolometer resistance, amplitude modulating the bolome- 
ter current, and appearing as side-bands adjacent to the 
carriers. These currents are summed at the input of the 
SQUID, which operates as a transimpedance amplifier. 
To avoid flux-burdening the SQUID with the large bias 
carriers, an inverted copy of the carrier "comb," called 
the nuller, is injected at the SQUID input from a second 



DMFS. The sky-signal modulated comb is digitized af- 
ter the SQUID circuit and each bolometer signal is sepa- 
rately demodulated in the digital multifrequency demod- 
ulator (DMFD), implemented in firmware. 

Each detector channel has its own demodulator, which 
provides only the in-phase "I" component. Including a 
second demodulator for each channel doubles the usage 
of FPGA fabric, increasing the power consumption, and 
does not provide any useful additional information. To 
align the demodulator phase with the carrier, account- 
ing for phase shifts in the cryostat, each module has an 
extra N th + 1 demodulator that can be used to momen- 
tarily measure the out-of-phase "Q" component of each 
detector. In addition to aligning the demodulator with the 
carrier, this "helper" demodulator is employed to provide 
extra information in the algorithms described below. 

Frequency domain multiplexing permits the reduction 
of cryogenic wires from two per bolometer to two per N 
bolometers, where TV is the multiplexing factor. The sys- 
tem is currently implemented with N = 8 and N = 16. 
Extension to much higher multiplexing factors is fea- 
sible but requires a substantial improvement in SQUID 
bandwidth, using methods such as those demonstrated in 
Ref. 0. 

TUNING 

Tuning the DfMUX system involves, (1) bringing the 
TES detectors above their superconducting transition and 
heat-cycling the SQUID to remove trapped flux, (2) tun- 
ing the SQUID to its optimum operating point and clos- 
ing its feedback loop, (3) placing a large sinusoidal bias 
voltage across the bolometers to keep them normal while 
the temperature of detector's thermal bath is lowered 
well below the transition, (4) nulling the bias carriers at 
the input of the SQUID with out-of-phase sinusoids, (5) 
lowering the TES into its transition by reducing the bias 
voltage, and (6) re-nulling to account for the changed 
bolometer impedance. The algorithms that accomplish 
these tasks are described below. 

SQUID Tuning Tuning the SQUIDs involves find- 
ing the operating points that allow for optimum perfor- 
mance. Small fabrication irregularities, device impuri- 
ties, and temperature gradients across the cryogenic sys- 
tem necessitate dedicated bias parameter tuning for each 
device. 

Before tuning the SQUIDs, they are heated above 
their superconducting transition by injecting a current at 
heater resistors that are located next to each SQUID in 
the cryostat. This releases any magnetic flux that may 
be trapped by the superconducting loops. After heating, 
it takes about 10 minutes for the SQUIDs to cool to a 
stable operating temperature. The bolometer stage is kept 
at 600 mK, just above the TES transition, by separate 



heater resistors near the focal plane, or in some cases 
through optical loading. 
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FIGURE 2. SQUID response curves at increasing SQUID 
biases from 80 to 115 jiA . Notice that the peak-to-peak am- 
plitude decreases with increasing SQUID bias (once the curves 
are above the lower rail) but that the curves become more sinu- 
soidal. 

The voltage response of the open-loop SQUIDs 
as a function of input current is shown in Figure [2] 
Each curve is taken with a distinct current through the 
SQUID junctions, called the SQUID bias. The first step 
of SQUID tuning is determining the optimal SQUID 
bias, which is a compromise between high peak-to-peak 
response (indicating a high transimpedance that will pro- 
vide more loop gain and lower noise in the flux locked 
loop circuit) and a symmetric sinusoidal response func- 
tion which results in stable, low-distortion SQUID op- 
eration for large input signals once feedback is applied. 
The algorithm measures the peak-to-peak response as a 
function of bias current by first measuring one entire re- 
sponse curve at a SQUID bias suspected to be near the 
maximum. The flux biases of the maximum and mini- 
mum SQUID response are determined. The SQUID bias 
range is then scanned with three measurements taken 
near the flux bias minimum and three near the maxi- 
mum. A parabolic fit is used to interpolate, determin- 
ing the minima, maxima, and peak-to-peak amplitude of 
each SQUID bias point. The SQUID bias is tuned to the 
point above the largest response with an amplitude of 
90% of the maximum peak-to-peak. This has been em- 
pirically determined to be a good compromise between 
transimpedance and large signal linearity. 

The second step is to adjust the flux bias such that 
the SQUID is operating on the inverting edge (to effect 
negative feedback) at the point where the dynamic range 
is maximized corresponding to half-way between the two 
extrema. This point is found by tracing out the SQUID 
response curve at the chosen SQUID bias point. 

With both the SQUID bias and flux bias tuned, the 
SQUID is locked in shunt-feedback by closing a switch 
connecting a feedback resistor from the output of a low- 
noise room temperature op-amp following the SQUID to 
the SQUID input inductor. The feedback serves to lin- 



earize the SQUID and extend its dynamic range, result- 
ing in greatly increased SQUID stability. 

Bolometer Overbiasing Before the bolometer stage 
can be lowered to its ~ 250 mK operating temperature, 
a large bias is applied at each bolometer frequency to 
keep the bolometers in their normal state. The required 
frequencies for these biases are determined in advance 
by scanning the comb with a carrier test signal. 

Overbiasing is essential, as the voltage bias provided 
by the backend electronics is not sufficiently large to 
drive a latched superconducting bolometer normal. 

Carrier Nulling The bias carrier amplitudes are sev- 
eral orders of magnitude larger than the sky signals and 
would create a substantial flux burden on the SQUID, 
pushing it out of its linear regime, if they were not 
removed at the SQUID input. This removal is accom- 
plished by injecting a "nulling comb" at the SQUID in- 
put, constructed from sinusoids that are inverted versions 
of the individual carriers. Because the carrier's current 
at the SQUID input depends on the bolometer operating 
point and cryostat wiring, it is necessary to adjust the 
phase and amplitude of each channel's nulling sinusoid 
to achieve good results. 
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FIGURE 3. A diagram of the nulling procedure. The first 
point, ptl, is measured with only the carrier present. The sec- 
ond, pt2, includes a calibration miller. The difference is used 
to calculate the phase and amplitude adjustments required to 
compensate for the carrier. 

Each carrier within a module is nulled one at a time 
after the bias is applied to the TES detector. In addition to 
the demodulator associated with each detector channel, 
the "helper" demodulator mentioned in the Introduction 
section is used to obtain a complex /, Q measurement 
of both amplitude and phase. Note that the phase of the 
demodulator is arbitrary with respect to the carrier. The 
algorithm proceeds as follows. First the carrier alone is 
measured, corresponding to ptl in Figure [3] Second, a 
nuller-calibration point is obtained by injecting a small 
nulling sinusoid (10% of the carrier setting) at arbitrary 
phase and measuring the amplitude and phase of the 
combined carrier and nuller signal, corresponding to pt2 
in Figure [3] This provides a relative measurement of the 



nuller' s amplitude and phase with respect to the carrier, 
allowing the calculation of the corrections required to 
properly null the carrier and return to the origin, or 
pt3 on Figure [3] This method has been very successful, 
the bias carrier is typically nulled to below 1% of its 
initial amplitude, allowing recovery of the sky-signal 
sidebands. 

With the carrier phase information, the channel's de- 
modulator phase is adjusted to be coincident with the car- 
rier, allowing the detector signal to be recovered with a 
single /-demodulation. The carrier and demodulator use 
the same system clock, so their relative phase will not 
wander. 

Bolometer Tuning With the bolometers overbiased 
and the bias carriers nulled, the temperature of the 
bolometer stage is lowered to its operating point, which 
takes about an hour. During this period the bolometers 
are held normal by the electrical power provided. The 
bolometers are then lowered into their transitions one at 
a time as follows. First, the relevant nuller is temporar- 
ily removed. Then, the carrier's bias voltage is ramped 
down, while the current is measured at the demodula- 
tor. The ramping is stopped when the TES's effective re- 
sistance reaches a value defined by the bolometer's sta- 
bility parameters, typically 50-80% of its normal resis- 
tance. Figure]?] shows typical TES resistance versus volt- 
age bias curve derived from this procedure. With the TES 
in its transition, a variant of the nulling procedure is re- 
peated, and the algorithm moves to the next bolometer in 
the module. 

1.50, . . . . . . 1 

1.45 f ''~ 
§1-40- 

CD 

21.35- 

ro / 

to i 

£1.30- 

cu / 
tJ 1.25 

o 

I 1.20 / 
1.15 / 



6.5 7.0 7.5 8.0 8.5 9.0 
voltage bias (^V rm J 

FIGURE 4. The TES resistance as a function of voltage bias 
is shown for a typical bolometer during the tuning process. 



SOFTWARE ARCHITECTURE 

In addition to implementing the DSP firmware that syn- 
thesizes the waveforms and demodulates the sky signals, 
the FPGA also houses a soft-core processor (Xilinx Mi- 
croblaze, www.xilinx.com) running the /iClinux (Peta- 
logix PetaLinux, www.petalogix.com) operating system, 



a port of Linux for embedded processors. This allows 
each DfMUX backend electronics board to manage and 
execute the software algorithms for the multiplexer mod- 
ules it handles. All interfaces, including data transport 
to the experiment's central control computers, is by eth- 
ernet. The embedded processor also provides a simple 
web-based interface for easy configuration and lab test- 
ing. System configuration changes such as running a tun- 
ing algorithm or setting carrier frequencies can be per- 
formed by sending TCP/IP commands or interactively 
through the webserver. 

The advantage of using web-standard interfaces for the 
DfMUX board is twofold. First, it enables cross-platform 
compatibility and, second, it permits higher level scripts 
to interact with the board in the same fashion regard- 
less of whether they are run on a separate machine or 
the FPGA itself. Thus, the development path for new 
algorithms is that they are first written, debugged, and 
tested on a remote computer executing low-level com- 
mands through the TCP/IP interface and later ported to 
the embedded processor's RAM disk where they can be 
run in parallel. A custom library, written in the Python 
scripting language, provides the interface to the system 
for both low-level commands and high level algorithms 
l9l . This library is the product of several years of devel- 
opment and can reliably tune bolometer arrays in min- 
utes. 

A key element in the scalability of the DfMUX system 
is the ability to parallelize the tuning of the system. This 
is facilitated by a web- server present on the embedded 
processor called the DfMUX Algorithm Manager (dal- 
gman). To request a given algorithm the user sends a 
string with the desired algorithm name and arguments 
over ethernet, and is given a key in return. The algorithm 
then runs on the embedded processor, and stores its data 
on the DfMUX RAM disk for later retrieval by a user 
supplying the proper key. Since each backend electron- 
ics board has its own embedded processor, the tuning is 
truly parallel and modular. 

The typical time required for setup and tuning of a 
DfMUX module of bolometers and SQUID is tabulated 
in the table below. Since the optimum SQUID bias is 
independent of observing conditions, the SQUID tuning 
time reported assumes the SQUID bias is known, so only 
the flux bias must be determined. A full SQUID tuning, 
including determining the SQUID bias, takes about 140 
seconds. 

Script Time (s) 

SQUID tuning 25 
Overbiasing + Nulling 142 
Bolometer Tuning + Renull 76 

Total 243 

Since the tuning of multiple modules occurs in par- 
allel, this will also be the time required for an array of 



any size. In principle, once the optimum parameter is 
found for each device and observing condition (such as 
bolometer optical loading and orientation of the SQUIDs 
in the earth's magnetic field), this value could be stored 
and programmed directly. However, since the tuning time 
is much shorter than the 2-3 hours required by the cryo- 
genics, and can happen in parallel, further optimization 
of the tuning time is unwarranted. 
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